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ABSTRACT 

We demonstrate a signal processing concept for imaging the sky at millisecond rates with radio 
interferometers. The "Pocket Correlator" (PoCo) correlates the signals from multiple elements of a 
radio interferometer fast enough to image brief, dispersed pulses. By the nature of interfcrometry, a 
millisecond correlator functions like a large, single-dish telescope, but with improved survey speed, 
spatial localization, calibration, and interference rejection. To test the concept, we installed PoCo 
at the Allen Telescope Array (ATA) to search for dispersed pulses from the Crab pulsar, B0329+54, 
and M31 using total-power, visibility-based, and image-plane techniques. In 1.7 hours of observing, 
PoCo detected 191 giant pulses from the Crab pulsar brighter than a typical 5<r sensitivity limit 
of 60 Jy over pulse widths of 3 milliseconds. Roughly 40% of pulses from pulsar B0329+54 were 
detected by using novel visibility-based techniques. Observations of M31 constrain the rate of pulses 
brighter than 190 Jy in a three degree region surrounding the galaxy to < 4.3 hr _1 . We calculate 
the computational demand of various visibility-based pulse search algorithms and demonstrate how 
compute clusters can help meet this demand. Larger implementations of the fast imaging concept will 
conduct blind searches for millisecond pulses in our Galaxy and beyond, providing a valuable probe 
of the interstellar/intergalactic media, discovering new kinds of radio transients, and localizing them 
to constrain models of their origin. 
Subject headings: 



1. INTRODUCTION 

Radio waves are rich with physical information en- 
coded in their spectral, polarimetric, and temporal 
chang es. Transient radio sources incl ude neutron 
stars (jMcLaughlin e t al. 200 6]), black hol es ([Fender et al.1 
Il999h . the Sun dBa stian et all Il998f >. and planets 
(Zar ka et al.lll996T) . In all of these examples, the tem- 
poral variation of radio emission has been critical to un- 
derstanding the nature of their emission. This success 
has inspired several blind surveys for transients with ra- 
dio interferometers i n the hopes of detecting rare events 
(iHvman et "all l2005t iBower et alJl2007_ ICroft et aT]|201Ct 
lLazio et al.ll2010D . 

Fast transients, with time scales shorter than 1 s, hold 
particular promise for discovery. Physically, transients 
of this duration are extremely ene rgetic, so they can b e 
detected to very large distances ([Hankins et al.l f2003). 
Large distances imply a large volume over which they 
may be detected, increasing the chance to see rare phe- 
nomena. Several hypothesized classes of transients may 
be so rare t hat they are only detectab le over cosmolog- 
ical scales ([Hansen fc Lvutikovl 120011 ) . At millisecond 
time scales, dispersion by the interstellar and intergalac- 
tic media can (and must) be measured. This opens the 
possibility of using large samples of transients to measure 
the d ensity of the intergalactic medium in an entirely new 
way ([Cordes fc Lazioll2003t iMcLaughlin fc Cordesll2003l ) . 

New understanding of fast transients has generally 
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come from advances in signal processing. Any astrophys- 
ical pulse will have millisecond-scale time structure and 
megahertz-scale frequency structure induced by disper- 
sion in the interstellar medium. The first millisecond pul- 
sar was discovered by pushing analog signal processing 
to new time scales ([Backer et al.l[L982[ ). Modern digital 
signal processing is advancing the held th rough flexibility 
and rapid deployment of n ew concepts (jvon Korff et al.l 
I2009t iMacauart et alj|2010h . 

Here we describe an instrument designed to image the 
radio sky at millisecond rates w ith the Allen Telescope 
Array (ATA: IWelch et al.l [20091) . This system, called 
the Pocket Correlator (PoCo), is conceptually similar to 
other correlators for radio interferometers, except that it 
integrates on time scales about 1000 times shorter. As 
we describe below, this enables highly efficient surveys 
for fast radio transients. Section [2] describes how PoCo 
was implemented at the ATA. We observed the Crab pul- 
sar and B0329+54 to prove the fast imaging concept and 
then observed M31 to search for the first millisecond ra- 
dio pulses from a large external galaxy. In fJ3]we compare 
different algorithms for detecting fast transients. In g[ 
we present science results from PoCo observations, in- 
cluding limits on the rate of millisecond pulses in M31. 
Finally, ij5l concludes with potential future implementa- 
tions of the fast imaging concept. 

2. FAST IMAGING WITH POCO 

2.1. Fast Imaging 

Fast imaging is the use of radio interferometers to im- 
age on time scales less than one second. This time scale 
is arbitrary, but serves as a useful definition because it 
describes when pulsar pulse profiles and Galactic disper- 
sion are resolved at radio wavelengths. This is a physical 
domain not traditionally explored by radio imaging. 
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Fundamentally, the benefits of fast imaging come from 
the fact that an interferometer preserves phase informa- 
tion across its aperture. As a result, an interferome- 
ter can encompass and extend upon science currently 
done with single-dish telescopes. Specifically, fast imag- 
ing provides: 

• Increased survey speed by using small apertures 
typical of interferometers, 

• Improved source localization, which is critical for 
multi-wavelength identification, and 

• Better interference rejection and calibration by us- 
ing multiple independent receivers. 

Large, single-dish radio observatories have tradition- 
ally been the workhorses of fast time-domain astron- 
omy (e.g.. ICordes et ai1l2006l ). Survey speed scales as 
Nb£lb(A c /T sys ) 2 , where iVb is the number of beams on 
the sky, fib is the area covered by each beam, A e f{ is the 
effective a rea of the telescope, and T svs is the system tem- 
perature (|Cordesll2008t lD'Addaridl2010l ). For a dish or 
array of diameter D with N a elements, this survey speed 
scales as N^N 2 D 2 . This shows that large telescopes are 
very efficient at su rveying, especially w ith the advent of 
multi-pixel feeds (jLorimer et al.1 12006T ) . However, fast 
imaging with interferometers consisting of small dishes 
synthesizes of order hundreds of beams simultaneously; 
this compensates for their small effective area and gives a 
competitive survey speed at fast sampling rates. For ex- 
ample, a 42-dish fast-imaging system at the ATA would 
have a survey speed a few hundred times higher than a 
19-beam phased array feed at the Green Bank Telescope. 

These improvements come with the challenge of much 
greater signal processing in the digital domain and mas- 
sive data volumes. The large data volumes in time- 
domain astronomy have motivated a two-step "detect 
then analyze" approach; search algorithms produce can- 
didate transients that are later analyzed in detail. A 
recent demonstration of how to use interferometers to 
survey for fast transients is V-FAST R, which detected 
pulses incoherently acr oss the VLBA (iWavth et al.ll20Tl 
iThompson et al.ll2011[ ). We developed PoCo to demon- 
strate the signal processing and algorithms needed to co- 
herently detect pulses (i.e., with visibility data). 

2.2. PoCo 

Like many correlators in use today, the standard cor- 
relator at the ATA wa s designed t o dum p visibilities on 
timescales of seconds. lLaw et all ()2009l ) describe a test 
of the fast imaging concept applied to pulsar B0329+54 
integrating with the standard ATA correlator at 100-ms 
rates. This test showed that a correlator could be used to 
image the on-pulse emission of a pulsar, but did not have 
the temporal resolution or bandwidth needed to measure 
dispersion. Therefore a small, special-purpose correlator 
was conceived as a pathfinding instrument towards fu- 
ture fast-imaging instruments. 

2.2.1. Detailed Instrument Description 

Table [1] summarizes the capabilities of the Pocket Cor- 
relator. The design used for this experiment was com- 
posed of a single ROACH board from the CASPER 6 col- 

6 See http://casper.berkeley.edu 



TABLE 1 
Summary of PoCo 
Capabilities 



Property 


Value 


Antennas 


8 


Channels 


64 


Bandwidth 


104 MHz 


Shortest int. time 


78.8 (is 
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Fig. 1. — Diagram of the PoCo signal path. 

laboration combined with a pair of quad-input analog-to- 
digital converters (ADCs) and a host computer to cap- 
ture the visibility data. Eight input signals were Nyquist 
sampled to provide 104 MHz of bandwidth. The eight in- 
puts were connected to a single polarization from each of 
eight ATA antennas and were down-converted and anti- 
alias filtered for the second Nyquist zone spanning 104- 
208 MHz. 

After digitization, a variable length integer delay of 
up to 256 samples was applied to each input for coarse 
geometric delay compensation. The signals were then 
channelized using a 2-tap polyphase filterbank with 64 
channels. The raw complex voltages from each filter- 
bank channel were then multiplied by a scaling factor, 
after which the real and imaginary parts were rounded 
and truncated to 4 bits. The data were then transposed 
to time ste p, antenna, frequen cy order. A pipelined ar- 
chitecture ()Parsons et al.ll2008l) X-engine then calculated 
all of the cross multiplications and internally accumu- 
lated the products for 128 time steps, corresponding to 
an integration time of 128 x 128/208MHz ~ 78.8/xs. The 
data were then grouped into packets and transmitted by 
10 gigabit Ethernet to a receiving computer. On the re- 
ceiving computer, the data were then further integrated 
to reduce the final data rate before storing to disk. 

Many aspects of the hardware design were motivated 
by the rapid deployment of the instrument. In particu- 
lar, the hardware available on a ROACH board should 
provide sufficient resources to form at least 1024 channels 
and to provide a longer onboard integration length. The 
design presented here fit easily within the resources pro- 
vided by the FPGA and did not require the complexities 
of off-chip memory 

2.3. Observations 

PoCo was designed and commissioned in the middle of 
2010. The instrument was temporarily installed at the 
ATA, located at the Hat Creek Radio Observatory in 
northern California. The array is composed of 42 6.1-m 
dishes, eac h equipped with a receiver sensitive from 0.5 
to 11 GHz (| Welch et alJl2009f >. The entire bandpass was 
sent as an analog signal over optical fiber into the on-site 
signal processing room, where PoCo was located. 

Eight, single-polarization, analog antenna signals were 
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TABLE 2 

Summary of PoCo Science Observations 



Target Mean Freq. Int. time Duration Calibrator 
(MHz) (ms) (hour) 



Crab pulsar 753 1.26 1.74 Crab nebula 

B0329+54 753 1.26 0.96 3C 147 

M31 753 1.26 0.70 Cas A 



sent to PoCo. Only x (horizontal) polarizations were 
used for all observations described here. Antennas were 
chosen from the southwest corner of the array, with a 
maximum baseline of about 170 meters. 

Installation, commissioning, and science observations 
with PoCo were done from July 23-25, 2010 7 . Since 
PoCo does not correct for geometric delays in real time, 
the observations were made in short (~ 1 hour) seg- 
ments during which delay changes were too small to cause 
decorrelation. In practice, this required calculating the 
sum of electronic and geometric delays for some time dur- 
ing the observation, fixing those as coarse delays in PoCo, 
then observing while the delays were valid. A postpro- 
cessing script then applied the time-dependent geomet- 
ric delays (a.k.a. "fringe rotation") to each integration, 
baseline, and frequency channel. 

This method was tested by observing a bright, con- 
stant source like Cygnus A over a range of hour angles 
and measuring the correlation amplitude and delay errors 
before and after postprocessing. This test showed that 
the delay errors were stable and small enough to be cali- 
brated. Inspecting the data showed that three antennas 
had low cross-correlation power, likely due to an error 
in the PoCo design. Those antennas were flagged and 
ignored in all subsequent analysis. An additional base- 
line had cross-correlations with non-astrophysical time 
and frequency structure, possibly due to analog coupling 
( "cross talk" ) between the signal paths of those two an- 
tennas. In the end, PoCo produced nine, science-quality 
cross-correlated spectra per integration. 

Table [2] summarizes the PoCo science observations. To 
test the system on known fast transients, we observed the 
Crab pulsar and B0329+54, two pulsars known for hav- 
ing bright individual pulses. The Crab pulsar is located 
in a bright pulsar wind nebula, while B0329+54 is not 
detectable outside its pulsed emission. Observing at fre- 
quencies from 718 to 822 MHz, a disp ersion measure of 
57 pc cm -3 (typical of the Crab pulsar: [Manchester et al.l 
|2005|) produces dispersion smearing up to 2 ms per chan- 
nel, similar to the typical integration time used. For dis- 
persion measures of 126 pc cm~ 3 , the largest used here, 
the dispersion smearing is at most 5 ms per channel. Ob- 
serving near 750 MHz balances the need for bright pulses 
against the sensitivity loss due to dispersion smearing. 

2.4. Calibration and Flagging 

The calibration of a fast correlator is largely the same 
as calibration of traditional correlators. The fact that 
an interferometer only measures flux on small spatial 
scales avoids a whole class of systematic errors seen in 
time-domain studies with single dish observatories (e.g., 

7 More details available at the observing log at 
http : //log . hero . org/content/poco 



ground spillover, atmospheric emission; IP 'Neil I2002T ). 
Cross correlations are also used to calibrate electronic 
gains of each antenna fo r accurate absolute flux calibra- 
tion (jBarott et alj|2011l) . 

For PoCo observations of the Crab pulsar, we use the 
Crab nebula (a.k.a. Taurus A) for gain and bandpass 
calibration. The Crab nebula is relatively compact (~6') 
with a well-calibrated flu x (1127 Jy at 770 MHz with 
a spectral index of -0.3; iBaars et al.l Il97"7h . making it 
suitable for self-calibration. The Crab data were gain 
calibrated at 3 minute intervals, but the solutions show 
variations smaller than 10% on hour time scales. 

Observations of B0329+54 and M31 could not be self 
calibrated, so solutions were transferred from observa- 
tions of 3C 147 8 and Cassiopeia A (2417 Jy at 770 MHz 
with a spectral index of -0.77; IBaars et al.l 119771 ) . re- 
spectively. Because coarse delays were fixed by PoCo, 
transferring calibration solutions required observing the 
target/calibrator pairs with the same set of delays. Af- 
ter fringe rotation was applied offline, the difference in 
geometric delays for the target / calibrator pointings was 
applied to the calibrator data. This method produced 
bandpass and gain calibrations appropriate for transfer- 
ring to the target. The gain amplitude and phase solu- 
tions were similar to each other (within 20%) and the 
Crab self-calibration solutions, as expected for observa- 
tions spanning a few hours at the ATA. The B0329+54 
data were calibrated from a single solution derived from 
3C 147. The M31 data were calibrated from a solution 
derived from observations of Cassiopeia A made before 
and after the M31 observation. 

All three gain calibrators have less than a few per- 
cent integrated linear polarization at cm w avelengths 
(lAnderson et al.lfl995l IWilson fc Weilerlll997lh The cal- 
ibration solutions based on the x-polarization data will 
not be biased by calibrator polarization. Naturally, a 
strongly linearly polarized source will not be detected if 
it is not oriented with the x portion of the feed. 

For simplicity, a single set of flags was applied to all 
data used here. Roughly half of the band was flagged to 
remove edge channels and interference. Broad-band in- 
terference, possibly from analog television, affected fre- 
quencies near 750 and 780 MHz. This flagging left 27 
channels for a total bandwidth of 43.9 MHz and mean 
frequency of 753 MHz. No flagging of individual integra- 
tions was done, so intermittent RFI remains in the data. 
All candidate pulses are visually inspected to reject RFI- 
triggered detections. 

2.5. Data Quality 

This section presents visualizations of PoCo complex 
visibilities to quantify the overall data quality. We used 
observations pointed at the Crab nebula, 3C 147, and 
Cassiopeia A to gauge data quality. All of these sources 
are relatively compact, so their visibilities are easy to 
interpret. 

Figure [2] shows calibrated spectra for each baseline 
during a three minute observation of the Crab nebula. 
The calibration model (described in detail in M2.4p as- 
sumes that the Crab nebula is compact, that is, much 
smaller than the 9' synthesized beam of our subset of the 

8 We use t he VLA calibration model as im plemented in Miriad. 
See http://www.vla.nrao . edu/astro/calib/manual/polcal .html 
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Fig. 2. — Amplitude spectra in units of Janskys for each of 
the nine good PoCo baselines toward the Crab nebula. Each plot 
shows the mean, 64-channel, 104-MHz spectrum averaged over 3 
minutes. 

full array. However, after calibrating with this model, 
there is ~30% amplitude variation between baselines, 
with the longer baselines significantly lower than the 
shortest baselines. This is consistent with a marginally- 
resolved source with a Gaussian full width at half-max 
(FWH M) of about 3', similar to the size of the Crab 
nebula (|Bietenholtz et ail ll997). Since the size of this 
variation is small (i.e., comparable to the weighting used 
in imaging algorithms), we keep the simplifying assump- 
tion that the nebula is unresolved. 

Figure [3] shows the distribution of the visibilities in 
real-imaginary space for a five minute observation of 
3C 147. Each point shows the visibility for a baseline 
in a 77-ms integration for one channel. The distribu- 
tion of points in real-imaginary space is predominantly 
real and Gaussian distributed, showing that there are 
no significant systematic errors. All targets show sim- 
ilar characteristics down to a level of a ~ 10 Janskys 
on time scales of milliseconds. At longer time scales, all 
fields show evidence for non-Gaussianity at flux levels of 
a few Ja nskys. In all ca ses, these signals obey closure 
relations (Cornwcll 1989), indicating that they are asso- 
ciated with celestial emission or calibration errors rather 
than correlator-based problems. 

The radiometer equation relates the expected sensitiv- 
ity to observing parameters as 

as = SEFD/\/n w rB, (1) 

where SEFD is the system equivalent flux density, is 
the number of baselines, r is the integration time, and 
B is the bandwidth. The distribution of visibilities of 
3C 147, the only truly unresolved calibrator observed, 
can be used to independently measure the noise level. 
The standard deviation of visibilities per channel, base- 
line, and 77-ms integration is 24 Jy. Using Equation 
[TJ we measure a system equivalent flux density of 8500 
Jy. This is consistent with that measured by regular 
ATA calibration ob servations and under ideal conditions 
([Welch et al. 2009). For a single 1.2 ms integration, the 
PoCo sensitivity is 192 Jy per 1.625-MHz channel and 
baseline, or 12 Jy per integration using all good base- 
lines and channels. In most cases considered below, the 
noise level is lower because it is measured in dedispersed 
data with pulse widths wider than a single integration. 
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Fig. 3. — Complex visibilities in units of Janskys averaged over 
frequency for a 3 minute observation of 3C 147. Each point shows 
the visibility of a baseline in a 0. 77-ms integration in a single chan- 
nel 1.625 MHz channel. 

3. ANALYSIS 

While a fast correlator may be thought of as a normal 
correlator integrating more rapidly, some aspects of tran- 
sients science at this time scale are new. This section 
describes dedispersion and source detection with PoCo 
data, including aspects that are unique to millisecond 
time scale interferometry. The Miriad software package 
was used for PoCo calibration and some visualization, 
while Miriad-Python 9 was used to build the pulse de- 
tection and analysis pipelines. 

3.1. Dedispersion 

Dispersion introduces an entirely new set of con- 
siderations to the analysis of visibility data. In the 
search for individual pulses, dispersion smears the emis- 
sion over several integratio ns and reduces sensitivity 
(jCordes & McLaughlinll2003lh 

For PoCo analysis, we dedisperse by reading blocks of 
a few thousand integrations (i.e. a few seconds) into 
Python and calculating dispersion-corrected, complex 
visibilities for each baseline. The output of the dedisper- 
sion process is a single spectrum for each baseline that 
has been compensated for the time shift for an assumed 
dispersion measure (DM) and pulse time in the absence 
of dispersion (t ). The spectrum represents the mean 
visibility over the pulse duration, which is the quadra- 
ture sum of the intrinsic pulse width and the time for 
the pulse to sweep through each channel. 

The center of the dispersion trial in time is 

t = 4.15 x lQ- 3 DMiy- 2 +t , (2) 

where v is defined in GHz, t and to in seconds, and DM 
in pc cm -3 . The pulse width is the time it takes the pulse 
to disperse through a channel, which is the derivative of 
Equation [2] or 

9 See http://purl.oclc.org/net/pkgwpub/miriad-python 
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Fig. 4. — Dynamic spectrum of ~ 800-Jy pulse seen by PoCo 
toward the Crab pulsar. The dots show the dispersion track that 
maximizes the sensitivity to this pulse, assum ing a typical Crab 
pulsar DM of 56.8 pc cm -3 jBhat et al.H2007l) . Flagged data arc 
blanked and edge channels arc not shown. 



dt = 8.3 x lQ-^DMAi 



(3) 



wher e Ais has units of GHz (|Cordes fc M cLaughlin 
120031 ). For pulsar B0329+54 the intrinsic pulse width is 
6.6 ms ()Lorimer et al.l []"!)!)">;. while for all other targets, 
the pulse width is assumed to be much smaller than the 
1.2 ms integration time. 

Figure @] shows a dynamic spectrum toward the Crab 
pulsar made by the beamforming technique (see E)3.2.ip . 
To our knowledge, this is the first time such a plot has 
been made from visibility data. The dispersed pulse has 
a mean flux density of ~ 800 Jy and is clearly visible 
across the PoCo band. The dispersion trial that maxi- 
mizes the signal-to-noi se ratio has DM = 56.8, consis- 
tent with expectations (|Bhat et al.ll2007|) ; the dispersion 
track is shown as white dots near the bottom of each 
channel. 

3.2. Pulse Detection Algorithms 

This section describes four algorithms for detecting 
transients in data with dimensions of time, frequency, 
and spatial frequency. Since an astrophysical signal will 
be coherent across the array, we show that imaging is 
an efficient way of detecting transients anywhere in the 
field of view. If the location of the transient is known, 
an individual pixel can be imaged in a process called 
beam forming. Treating the detection process as an opti- 
mization problem, we show that one can detect pulses by 
fitting a model. Finally, we describe a set of statistical 
techniques for detecting pulses. We demonstrate the fea- 
tures and limitations of each algorithm and benchmark 
their computational demand. 

3.2.1. Beam forming 

For calibrated visibility data, the real part of the mean 
cross correlation eff ectively synthesizes a beam at the 
array phase center (|Thonrpson et al.1l2004f ). Using the 
real part of the visibility instead of its amplitude has the 
benefit of being Gaussian distributed with zero mean in 
the absence of flux. The output of the beam forming 
process is a value for each channel and integration (e.g., 
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Fig. 5. — Flux density distribution of B0329+54 pulses detected 
with greater than 5<r confidence by the beamforming algorithm. 
The histogram shows the flux density distribution for all 2024 
pulses as measured after detection by fitting a powerlaw to their 
pulse spectrum. Errorbars show th e uncertainty in the bin count 
assuming a Poissonian distribution ( Gchrcls 1986). The yellow line 
shows the best-fit powerlaw to the brighter pulses in the flux den- 
sity distribution. 

see Figure 2]) , reducing the detection problem to that of 
single-dish transients searches. The sensitivity pattern is 
the dirty beam centered at the phase center of the array. 

Detecting a pulse in a dynamic spectrum requires 
searching ded ispersed trials for excess power (e.g., 
Ransom 2001). Because the detection of a pulse is done 
on the mean of the real part of the visibility, the pulse 
must be coherent across the array. This coherency is not 
to be confused with how dispersed pulses are coherently 
integrated in frequency and t ime, which is often calle d 
"coherent dedispersion" fe.g.. lHankins fc Rickettj[T975l) . 
The result of our dedispersion process is a distribution 
of values in DM-time space that is Gaussian distributed 
with a mean equal to the brightness at the phase center. 
Candidate pulses are found by selecting DM trials with 
brightness greater than 5 times the noise measured in 
local DM trials. The cumulative probability distribution 
for a Gaussian function predicts that a 5rr threshold will 
include one false positive per 3.5 x 10 6 trials; this number 
is comparable to the number of integrations in an hour 
of PoCo data, so it is a convenient threshold. 

We demonstrate the beam forming algorithm by 
searching for pulses in 0.96 hours of data of B0329+54. 
For a 5<7 threshold, the beamforming algorithm detects 
2024 candidate pul ses, assuming DM = 26.8 pc cm~ 3 
(|Hobbs et al.l [2004) . This count excludes a few candi- 
date pulses associated with RFI seen in dynamic spectra 
and 46 candidates detected within the 6.6 ms pulse width 
(likely multiple detections of the same pulse). After de- 
tecting a pulse, a second pass is made to inspect each 
candidate pulse. Each pulse is fit with a powerlaw to 
measure its spectral index and mean flux density. The 
blue histogram in Figure [5] shows the distribution of flux 
density for the 2024 good candidate pulses detected in 
B0329+54. The flux density is the mean across the as- 
sumed pulse width of 6.6 ms and across all good channels, 
which is approximately equal to the flux density at 753 
MHz. 

Figure [5] shows the best-fit powerlaw distribution to 
the pulse brightness distribution. A powerlaw index of 
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TABLE 3 

Results of Pulse Detection Algorithms 



Source Algorithm Total Completeness Complete 



pulses limit pulses 



B0329+54 bcamforming 2024 55 Jy 1047 

B0329+54 imaging 1114 65 Jy 871 

B0329+54 uv fit 1855 55 Jy 1043 

Crab pulsar bcamforming 191 95 Jy 79 



a fast transient detection algorithm based on dirty im- 
ages. While cleaned images are visually appealing, they 
are computationally expensive to generate. Our tran- 
sient detection pipeline instead finds pulses by compar- 
ing the peak brightness in dirty images to the median 
dirty image noise level in other integrations. Since the 
field likely contains only a point source, the peak bright- 
ness of a dirty image is the same as that of a cleaned 
image. Creating and thresholding a dirty image requires 
no iterative process (like cleaning or fitting) and uses the 
Fast-Fourier Transform, so it is relatively computation- 
ally efficient. 

There are many other algorithms for detecting fast 
transients in this data. One alternative is to image the 
pulse in individual frequency-time bins. This is con- 
trasted to the technique used here of coherently sum- 
ming visibilities along a dispersion track before imaging. 
In analogy with dedispersion in time-domain astronomy, 
the imaging process is a "detection" of the signal, chang- 
ing the signal from from complex-valued visibilities to 
real-valued images. As with dedispersion, doing the de- 
tection before averaging reduces the sensitivity to the 
signal by mixing noise with signal in each time- frequency 
bin. 

The left side of Figure |] is a dirty 
image (also available as a movie at 
http: //www.youtube . com/watch?v=I9U8V-8EaOU| 
made from Background-subtracted data during the 
Crab giant pulse shown in Figure |4l In this and other 
tests, the dirty images are made using the standard 
multi-frequency synthesis algorithm with 80" pixels and 
250 pixels across to fully cover the primary beam. The 
right side of Figure |6] shows how the peak and noise level 
of the dirty images change near the same pulse. The 
peak pulse brightness is the same in the dirty image as in 
the cleaned image in the left panel, but the differencing 
over a 10 integration window produces false detections 
near the pulse time. We treat all detections within the 
background subtraction window as a single event. 

The detection threshold for the imaging algorithm is 
defined to produce the same false-positive rate as the 
bcamforming technique. It is difficult to measure the 
false-positive rate when only one false positive is ex- 
pected in the B0329+54 data. A proxy for the false- 
positive rate is the number of candidate pulses with mean 
flux density less than the median noise level in a disper- 
sion trial (~ 5.7 Jy). We found that an image peak 
threshold of 7 times the median noise level produces ap- 
proximately the number of low-flux candidates as the 5a 
threshold used with the beamforming algorithm for the 
B0329+54 data. The false positive rate may be related 
to non-Gaussianity in the differenced visibilities. 

Figure [7] shows the pulse mean flux density histogram 
for candidate pulses detected by the imaging algorithm 
toward B0329+54. This histogram is compared to the 
beamforming and ww-fit algorithm (described below). In 
general, the imaging algorithm produced more candi- 
dates near RFI, since those images had high peak pixel 
brightnesses. After removing candidates near RFI seen 
in the dynamic spectra, we found a set of candidates with 
negative flux densities located within the background 
subtraction region of 12 ms; these candidates are also 
removed. After this filtering, the imaging algorithm de- 



-2.2 describes the brightness distribution for all pulses 
brighter than 40 Jy. Comparing the best-fit powerlaw to 
the detected pulse distribution shows that the all pulses 
brighter than approximately 55 Jy are detected. This 
defines the completeness limit, which is roughly 10 times 
nominal noise level of 5.7 Jy per DM trial. Table [3] sum- 
marizes the results of pulse detection algorithms for ob- 
servations of B0329+54 and the Crab pulsar. 

We detect 1047 pulses above the completeness limit, 
which is 22% of the possible pulse detections (i.e., the 
number of rotations of pulsar during observ ation). For a 
mean brightness of ~556 mJy at 753 MHz (iHobbs et al.l 
120041 ) and a pulse width of about 6.6 m s (containing 50% 
of the pulse flux; lLorimer et al.l [19951 ) . the mean pulse 
will have a brightness about 30 J y. The pulse energy dis- 
tribution of lKramer et al.1 (|2003l ) shows that 10-30% of 
pulses should be detected for a completeness limit within 
a factor of two of the mean brightness. Thus, the de- 
tection rate of 22% for a completeness limit of 55 Jy is 
consistent with expectations. 

Because the beamforming technique is simple and it 
produces results consistent with expectations, we apply 
it to science applications with B0329+54 and the Crab 
pulsar in fJU Below, detections made by other algorithms 
are compared to the beamforming algorithm to define 
detection thresholds and other properties. 

3.2.2. Imaging 

The utility of a fast correlator comes not from beam 
forming, but from using the visibilities to locate sources. 
In these kinds of applications, we calculate the mean 
complex visibility in each channel over a window of width 
dt centered at t. This produces a set of dedispersed spec- 
tra for each baseline that can be imaged or fit with a uv 
model. 

A unique aspect of fast imaging is that systematic ef- 
fects of the array vary much more slowly than the tran- 
sients. The effects of gain calibration or changes in the 
uw-coverage due to the earth's rotation occur on time 
scales of minutes to hours. The rapidity of the transients 
means that visibilities can be differenced to remove sys- 
tematic effects. In the work presented here, we subtract 
mean visibilities calculated over a window of 12 ms out- 
side of the DM trial. 

Another unique aspect of fast transients is that they 
are single, point-like sources. Causality requires a tran- 
sient of timescale At at distance d to be smaller than 
9 ?» cAt/d. By this reasoning, a millisecond transient at 
a distance greater than a parsec must be smaller than a 
micro arcsecond. Further assuming that no more than 
one fast transient occurs at any moment allows us to 
simplify our detection algorithm. 

In PoCo analysis, we use these assumptions to build 
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Fig. 6. — (Top:) Image of the 1.2-ms, dedispersed pulse shown 
in Figure [4] This image shows the peak brightness of the pulse and 
can also be viewed as a movie. The scale shows the brightness in 
Jansky beam -1 . The image and movie are made from background- 
subtracted visibilities over a window of 10 integrations (12 ms) 
outside of the pulse. (Bottom:) The peak and noise levels in dirty 
images as a function of time for 200 integrations near the same 
Crab pulse. Within a window of 10 integrations, the background 
subtraction produces negative artifacts. 

tects 1114 unique, good candidates. 

Using the pulse distribution measured by the beam- 
forming algorithm, the imaging algorithm diverges from 
100% completeness at approximately 65 Jy, or 12 times 
the nominal noise. So the imaging algorithm is approx- 
imately 20% less sensitive than the beamforming algo- 
rithm. As summarized in Table 871 unique pulses are 
detected above the completeness limit in this 0.97 hour 
observation. More importantly, the histogram from the 
imaging algorithm is very similar to that of the beam- 
forming algorithm, showing that they are finding the 
same candidates. Some small differences may arise be- 
tween algorithms if they associate a given pulse with 
slightly different integrations. 

As a final test of the imaging algorithm, we simulated 
observations with pulses away from the phase center. In 
this case we used data of the Crab with its phase center 
shifted by 6', 24', and 1°. To assure that the gridding 
of the image didn't affect the signal-to-noise of the de- 
tection, the synthesized beam need to be slightly over 
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Fig. 7. — Flux density distribution of pulses detected by three 
algorithms in 0.96 hours of PoCo data of B0329+54. In all cases, 
the pulses are first detected, then the beamforming technique is 
used to generate a pulse spectrum that is then fit with a power- 
law. The light blue bars show a histogram of pulse flux density 
detected with the beamforming algorithm. The yellow and red 
lines show the histograms of detections with the uv-fit and imag- 
ing algorithms, respectively. Errorbars show t he uncertainty in the 
bin count assuming a Poissonian distribution (Gchrcls 19§3). 

sampled with an image pixel size 70". After making this 
change, our tests showed that the imaging algorithm de- 
tected pulses with identical signal-to-noise ratios regard- 
less of their location in the primary beam. 

3.2.3. uv-fitting 

Analogous with the imaging approach to pulse detec- 
tion, the visibilities can be modeled directly in an ap- 
proach called u uv fitting" . Fitting visibilities is relatively 
simple for fast transients applications because the signal 
is a compact source changing on rapid time scales. The 
fit also provides robust statistics that can be used to 
evaluate the likelihood that the candidate is real. 

Our implementation of uw-fitting is similar to our 
imaging algorithms in that DM trials are used to out- 
put dispersion-corrected visibility spectra. The uv fit is 
done by running the Miriad task "uvfit" on the dedis- 
persed visibility spectra. The task fits a point source sky 
model to the data and returns best-fit parameter values 
and their errors. The free parameters of the model are 
the location of the source and its brightness. 

As with the imaging algorithm, the threshold for de- 
tecting a pulse is set to include the same number of false 
positives as the beamforming technique. Because the uv 
fit includes the source location, in addition to its peak 
brightness, the significance of the best-fit peak can be 
overestimated. Comparing the number of false-positives 
detected toward B0329+54 using the beamforming algo- 
rithm, we set a threshold on the uv-fit peak significance 
of 5.6ct. 

Figure [7] shows the mean flux density for all pulses de- 
tected by the uv-fit algorithm in yellow. As with the 
imaging algorithm, pulses brighter than the complete- 
ness limit have a similar distribution as the beamform- 
ing technique. The completeness limit inferred from the 
powerlaw measured in the beamforming technique ap- 
proximately 55 Jy and includes 1043 pulses, similar to 
the beamforming algorithm. Table [3] summarizes the re- 
sults of the itv-fitting algorithm in comparison to the 
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other algorithms. 

As with the image fitting technique, we tested how well 
the uv-fitting technique found off-axis pulses. For pulses 
more than a few beamwidths away from the phase center, 
the uu-fitting technique failed to find the pulse. Exper- 
imenting with fitting algorithms showed that the small 
number of baselines in the PoCo data produced many lo- 
cal minima in the x 2 surface. This happens for the same 
reason the synthesized beam has many sidelobes of simi- 
lar amplitude to the main lobe. In we demonstrate 
how iteratively iw-fitting throughout the primary beam 
can be used to test candidate pulses. 

For our goal of finding a pulse-detection algorithm, the 
ww-fitting approach was computationally expensive and 
had a higher false-positive rate. This is partly because 
the algorithm was designed to measure properties of the 
visibilities, which is more than our requirement of a sim- 
ple detection. 

3.2.4. Statistical 

As shown in Figure El all pulse detection processes use 
the complex valued visibilities to search for deviations 
from Gaussianity. Since the volume of data to search 
is large, it is important that the algorithm is as simple 
and fast as possible. Here we discuss other statistical 
techniques to detect transients in fast correlator data. 

Generally, an uncalibrated visibility toward a compact 
celestial source can be written as 

y i = J g-j27r(u i i+D i m+0 i ) 

where Uj, Wj, and cf>i are the uv coordinates and phase 
error for a given baseline, while I and m are the di- 
rection cosines of a poi nt source on the celestial sphere 
(jThompson et~all[2nnl . For a source at the phase cen- 
ter, I = m = and thus Vi — Je - - 7 ' 2 *^ 1 . For a source 
detected with an array with many baselines with differ- 
ent phase errors, the visibilities are distributed in an an- 
nulus in the real-imaginary plane of radius /. Given the 
structure of Equation 01 a compact source anywhere in 
the field of view of the array will have a similar pattern 
in the real-imaginary plane. 

The distribution of visibilities in real-imaginary space 
can be used to detect time dependent astrophysical sig- 
nals. As noted earlier, differencing of individual visi- 
bilities removes steady emission and systematic effects, 
producing Gaussian-distributed, zero-mean visibilities. 
This reduces the pulse detection problem to that of re- 
jecting the null hypothesis of Gaussianity, a problem 
with many potential solution s (e.g., skew and kurtosis; 
iD'Agnostino fc Pearsor]|197lD . 

We test this idea using the standard deviation of visi- 
bilities in the real-imaginary plane 10 Figure [8] shows how 
the standard deviation over all channels, times, and base- 
lines changes during the Crab pulse shown in Figures [4] 
and [6] The pulse produces a roughly 28c deviation from 
the typical value, as compared to a detection significance 
of 58cr for this pulse using the beamforming algorithm. 
Given the formal connection between gain phase errors 
and the visibilities of off-axis sources, this technique can 
also be used to detect pulses in uncalibrated data. 

10 The standard deviation of a complex number is equal to the 
quadrature sum of the standard deviation of the real and imaginary 
parts. 
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Fig. 8. — Time dependence of the standard deviation of visibil- 
ities in real-imaginary space. This plot shows how the visibilities 
change during the PoCo observation of the Crab pulse shown in 
Figures [4] and [6] 

This statistical test may be thought of as a semi- 
coherent detection process. While we rely on the co- 
herency of the signal in the visibility domain, we do not 
use our knowledge of the uv coordinates of the base- 
lines. As a result, some information about the signal's 
coherency is lost. Since this algorithm is not as sensitive 
as the beamforming or imaging algorithms, we did not 
apply it beyond this simple test. 

3.3. Computational Demand 

A significant challenge for fast imaging is handling the 
computation required to search for pulses. The computa- 
tional demand for a pulse search algorithm can be written 
as a computational demand per search multiplied by the 
number of searches, or 



a 



search — 



2 t obs (DM,-, 

^pulsc 



DM min ) 
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where S is the per-search demand (measured either in 
operations or time), DM is dispersion measure, and 
£ P uisc is the pulse width. The factor of two comes 
from Nyquist sampling of the pulse width in time. 
Rewriting this in terms of observational parameters 
(iCordes fc McLaughlinll20iD3h . we find 



Csoarch =S 1.44 x 10 7 t ohs (DM 
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DM„ 
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where DM is measured in pc cm , Ai/ is the bandwidth 
in GHz, v is the observing frequency in GHz, t- m t is the 
integration time in milliseconds, and t bs is the observa- 
tion time in hours. Equation [6] assumes that pulses are 
unresolved in time cither due to intrinsic or detection 
effects (e.g., both pulse width and dispersion smearing). 

The details of the pulse search algorithm are contained 
in the per-search demand factor, S. Thinking of this as a 
measure of the number of computations, we can quantify 
scaling relations for our search algorithms. The beam- 
forming algorithm sums visibilities across all baselines 
and channels for a given dispersion trial, which implies 
processing demand that scales as §bf oc M * iV c han- Sim- 
ilarly, any statistical detection algorithm operating on a 
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dispersion trial effectively collapses data along dimen- 
sions of channels and baselines and will have a simi- 
lar computational demand scaling relation. Creating a 



dirty image requires 



(x M + N 2 * log 2 (N), where 



M is the number of baselines and N is the number 
of pixels on a side of an image. A uv fit is an iter- 
ative statistical process, which suggests a scaling like 
Suvfit oc M * iVchan * -^tar, where iVitor represents the 
typical number of iterations required to find a solution. 

The computational demand can also be measured em- 
pirically in units of time. We estimated § for each algo- 
rithm by taking the mean search time over many itera- 
tions. These times were measured with a serial version of 
the pulse search algorithms running on a 2.5 GHz, dual- 
core Intel core i5 processor. For the beamforming, im- 
age, and uv fit search algorithms, we found §bf — 0.02s, 
S 



image 



= 0.28s, and § uv fit = 0.10s, respectively. These 
relative speeds are consistent with the operations-based 
scaling relations described above. Note that in this case, 
the uv fit time is underestimated because it searched for 
pulses near the phase center only; a search over the entire 
primary beam would inflate the search time by roughly 
two orders of magnitude. 

The fastest search algorithm described here processes 
data approximately 20 times slower than the data acqui- 
sition rate. Compute clusters will help meet this demand, 
especially since the search consists of millions of processes 
that can be run independently. Tree dedispersion algo- 
rithms can also improve per formance by sharing compu- 
tations between DM trials (jTavlorl [1974 ) . As described 
below, a search for pulses in M31 was run with a simple 
parallelization of running each of 29 different dispersion 
measure searches on a different processor. This produced 
an effective dirty image search time of §i mago = 0.02s, or 
14 times faster than the equivalent series search. Com- 
paring the number of processors and improvement in 
processing time implies a 50% parallelization efficiency; 
more work here will doubtless lead to further improve- 
ment. 

4. APPLICATION TO SOURCES 

With a working millisecond correlator, we sought to 
demonstrate the science possible with fast transients. 
Section|3]described algorithms for detecting pulses in fast 
correlator data. This section describes what happens af- 
ter detection, when pulses can be studied in more detail. 
This shows that the science of single-dish time domain 
astronomy can be implemented for an interferometer. 

4.1. Crab Giant Pulses 

We used the beamforming technique to search for 
pulses in 1.74 hours of da ta of the Crab pu lsar. Assum- 
ing a DM of 56.8 pc cm" 3 (|Bhat et alj|2007j ). we detected 
191 individual pulses above a 5a threshold. The typical 
noise per dispersion trial was about 12 Jy. This search 
covered 5 x 10 6 integrations, from which Gaussian statis- 
tics predicts approximately one 5cr false positive event. 
Note that the dispersion track has a typical width of 
about 2.5 integrations due to dispersion smearing, so the 
pulse brightness is averaged over 3 ms. This is a factor 
of 10 larger tha n the scatter-bro adened pulse width of 
roughly 300 /is (|Bhat et al.ll2007t) . so the detected pulse 
brightness is 10 times lower than the scatter-broadened 
pulse brightness. 
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Fig. 9. — Top: Brightness distribution of mean Crab pulse flux 
across PoCo band, centered at 753 MHz. The bars show a his- 
togram of detected pulses brighter than 5<r and the line shows a 
powerlaw model fit to all but the lowest two bins. The powerlaw 
has a slope a = —4.0. Bottom: A histogram of pulse spectral index 
fit to all pulses brighter than the completeness limit of 95 Jy. The 
yellow line shows the best-fit Gaussian with center at a = —1.1 
and width of 5. 

Figure [5] shows the Crab pulse brightness and spectral 
index distributions. The brightness distribution can be 
fit with a powerlaw distribution of N oc S a . For pulses 
brighter than 80 Jy, we measure a powerlaw index of a — 
—4.0. This index is similar t o the index of -3.5 me asured 
previously for giant pulses (|Lundgren et al.l ll"995). The 
best-fit powerlaw model suggests that the detected pulse 
distribution is complete above flux densities of 95 Jy, 
or roughly 12 times the typical noise level of 8 Jy per 
DM trial. As shown in Table [31 79 pulses are detected 
brighter than the completeness limit. 

Considering pulses brighter than the completeness 
limit, the pulse spectral index distribution is well fit by a 
Gaussian centered at a = —1.1 with width 5. The width 
of the spectral index distribution is defined by a combina- 
tion of sensitivity, bandwidth, and intrinsic effects. It is 
difficult to separate these effects for pulses over a range of 
signal-to-noise ratio. However, we note that Crab giant 
pulses have well-constrained spectral indices throughout 
this range. For example, the bright pulse shown in Fig- 
ured has a large, positive index of +19 across the PoCo 
b and. 

iBhat et all ((2007) compile the brightest pulse mea- 
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Fig. 10. — Histogram shows the distribution of spectral indexes 
fit to B0329+54 pulses brighter than the PoCo detection limit of 55 
Jy. The yellow line shows the best-fit Gaussian to the histogram, 
centered at a = —2.7. 

sured toward the Crab pulsar in 1 hour of observing as a 
function of frequency. Interpolating to the PoCo observa- 
tion suggests that we should detect a pulse of brightness 
several kJy in one hour. Correcting the PoCo apparent 
pulse brightnesses to the scatter-broadened pulse width, 
the brightest pulse detected in our observation was 7.5 
kJy. The second brightest pulse was 6 kJy. Taking a 
random 1-hour subset of this observation would likely 
detect one of these pulses, so the absolute rate of pulses 
is consistent with the giant pulse rate of the Crab pulsar. 

4.2. B0329+54 

As described in c]3.2.1[ we used the beamforming algo- 
rithms to find 2024 pulses above a 5a thresh old, assum- 
ing a DM of 26.8 pc cm" 3 (jHobbs et al.ll2004D . The pulse 
brightness distribution and number of pulses detected is 
consistent with predictions based on the sensitivity of 
PoCo. 

Figure [TU] shows the pulse spectral index distribu- 
tion for B0329+54 has a roughly Gaussian distribution. 
The histogram is made from pulses brighter than the 
completeness limit, which are bright enough to have 
good spectral fits. The center of the distribution is at 
a ss —2.7, similar to the mode of the pulse spectral in- 
dex distribution of -2.5 seen bv iKramer et al.1 ([20031 . 

Figure [TT] shows the brightness of B0329+54 pulses 
as a function of the pulse phase. The arrival time of 
PoCo pulses have a bimodal distribution, while the typ- 
ical pulse profile ob served by others has three peaks 
([Gould fc Lvndfl998l) . Ali gning these two profiles shows 
that PoCo only detects pulses from the leading and main 
component, but none from the trailing component. This 
shows that the PoCo observations coincided with an un- 
usu al mode of B0329+ 54 referred to as "Abnormal mode 
B" (jBartel et al.lll982l ). This mode occurs approximately 
10% of the time and lasts up to an hour. 

The pulse variability and spectral structure in 
B0329+54 has been e xtensively studied a s a probe of the 
interstellar medium ([Kramer et al.ll2003f ). B0329+54 is 
in the strong diffractive scintillation regime with Av rs 1 
MHz and At w 6 min. Given our channel size of 1.6 
MHz, we expect significant scintillation- induced struc- 
ture in the pulse spectra that should be stable over a 
series of about 500 pulses. 
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Fig. 11. — Pulse brightness as a function of pulse phase for 
PoCo observations of B0329+54. Red dots show the mean pulse 
brightness of the PoCo pulses ne ar 753 MHz. The blu e line shows 
the 610 MHz mean pulse profile (Gould & Lyne 1998) normalized 
to match the peak brightness detected by PoCo. 

Figure fTS] shows a series of dynamic spectra made of 
stacked spectra during pulses of B0329+54. Since the 
PoCo data detect only about 20% of all pulses, the scin- 
tillation timescale of 6 minutes (~ 500 pulses) covers 
roughly 100 PoCo pulses. Ignoring pulse-to-pulse bright- 
ness variation, the PoCo data show that the brightest 
pulsed emission typically appears in a single channel 
and that this channel changes on 100-pulse scales. This 
pattern is consistent with the scintillation time and fre- 
quency scales identified previously. 

4.3. MSI 

A major motivation for the development of fast cor- 
relators is to enable efficient surveys for extragalactic 
transients. M31 is a promising source of extragalactic 
fast transients, since it is the nearest Milky Way-like 
galaxy and is expected to har bor many Crab-like pulsars 
(jMcLaughlin fc Cordesl 120031) . The ATA field of view at 
750 MHz is 5°, which easily covers the 3° optical disk of 
M31. This makes M31 a good target to demonstrate the 
power of fast imaging at the ATA. 

We observed M31 for 0.7 hours using the same band 
and cadence as in other observations described here (see 
Table [5]). The search for pulses from M31 is more chal- 
lenging than previous searches in two ways. First, we 
don't know the location of the pulse, beyond that it 
should be within M31. This requires the use the dirty 
imaging pulse search algorithm described in c]3.2.2l We 
assumed that the pulses were temporally unresolved, so 
background subtraction is expected to reduce sensitivity 
to pulses longer than a few times the integration time of 
1.2 ms. Images were made with 70" pixels and 160 pix- 
els per side, covering more than the 3°span of the M31 
optical disk. 

A second complication to the M31 pulse search is that 
the pulse dispersion is not known. Fo llowing the de- 
scription of ICordes fc McLau ghlin (2003), dispersion tri- 
als were spaced by 2.7 pc cm -3 . This gives at least 50% 
sensitivity to pulse widths equal to the integration time, 
assuming a maximum frequency coverage of 73 MHz (the 
widest separation of unflagged channels). The nomi- 
nal DM through the G alaxy toward M31 is 67 pc cm~ 3 
(|Cordes &: Lazioll2003|) . Allowing for uncertainty in the 
Galactic DM and the potential for DM intrinsic to M31, 
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Fig. 12. — Dynamic spectra of the pulsed emission from 
B0329+54. Each panel shows spectra from a sequence of 200 pulses 
detected by the beamforming algorithm. Brightness in Janskys is 
coded by a color scale indicated next to the dynamic spectrum. 

we search over a DM range from 80% to 200% of the 
Galactic DM to M31. The final search was made with 29 
DMs from 50 to 126 pc cm" 3 . 

We searched for pulses using the UC Berkeley com- 
pute cluster called Henyey. The search algorithm was 
run with serial-compiled code, but sending each disper- 
sion measure to different processors in parallel. The data 
were loaded into the shared memory on each node to re- 
duce I/O latency. The false-positive rate for a 5a de- 
viation is 2.8 x 10 -7 . Taking the product of this with 
the total number of integrations searched, we expect 0.5 
false positive per DM trial or a total of about 15 false 
positives. 

The M31 pulse search produced 92 candidates events. 
While this is significantly more than the expected false 
positive rate, our experience with the dirty image algo- 
rithm has shown that it is sensitive to RFI. A secondary 
filter was set by searching data from each candidate with 
uv fit. A compact source was iteratively fit to the data 
on a grid of fixed locations; the peak brightness was the 
only free parameter for each fit. The result was a map of 
the peak brightness throughout the primary beam. We 
use the peak brightness signal to noise ratio in this map 
as the final test of the significance of the candidate. 

The left panel of Figure [13] shows a histogram of the 
peak signal to noise ratio measured by the uv fit routine 
for all 92 candidate pulses in M31. If we assume that 
set of dirty image candidates is made of true events, nor- 
mal false-positives, and RFI-induced false positives and 
that the uv fit routine is less susceptible to RFI, then 
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Fig. 13. — (Top:) Histogram of pulse signal to noise ratio of 
PoCo candidates toward M31. A total of 92 candidate pulses were 
detected by the imaging algorithm and confirmed with a uv fit. The 
measured signal to noise ratio corresponds to the peak fit across 
the entire field of view. (Bottom:) Spectrum of the brightest pulse 
detected by PoCo toward M31. The effective integration time is 
3.1 ms. 



thresholding this distribution will select the best events. 
Under these assumptions, the distribution of candidate 
pulse brightnesses measured by uv fit should be a trun- 
cated Gaussian, where events below 5er are related to 
RFI and events above 5a are either true or false posi- 
tives. This distribution is similar to that seen the left 
panel of Figure HH 

As noted in i j3.2.3l the uv fit algorithm itself has a false 
positive rate slightly higher than predicted by a Gaussian 
distribution. Using a threshold of 5.6a on a uv fit search 
produces the same false-positive rate as a 5a threshold 
with the beam forming algorithm. Applying the 5.6a 
threshold to the uv fit histogram, we find 12 candidates, 
consistent with the number of false positives expected 
for the number of dispersion trials. The right side of 
Figure [13] shows a spectrum measured by beam forming 
toward the location of the signal to noise peak of the 
brightest pulse detected by PoCo toward M31. The pulse 
was detected at a disperison measure of 66.2 pc cm~ 3 
and with lesser confidence in a neighboring dispersion 
trial. The spectrum was relatively flat, which excludes 
the possibility of an RFI-triggered event. 

Given that the number of candidates is consistent with 
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the false positive rate for our search, we cannot claim to 
have a definitive detection of a pulse from M31. Assum- 
ing none of these candidate pulses are real, we limit the 
rate of fast transients in M31. As shown in the Crab ob- 
servations, the completeness limit is 95 Jy when search- 
ing with the exact DM. Our DM spacing allows for a 
maximum of 50% signal loss, so our 100% completeness 
limit is 190 Jy. Assuming the pulse occurrence proba- 
bility follows a Poissonian distribution, a nondetection 
limits the rate of millisecond pulses to less than 4.3 hr _1 
at 95% confidence. 

A likely source of fast transients in M31 would be Crab- 
like pulsars. If Crab-like pulsar was located in M31, 
could we detect it? In the 1.7 hours of observing the 
Crab pulsar with PoCo, the brightest pulse was 710 Jy. 
Scali ng this pulse brigh tness to the distance of M31 (772 
kpc; iRibas et"aLll2005|) reduces it to a factor of 4 x 10 4 
lower than our complet eness limit. For a pul se energy 
powerlaw index of -3.5 (jLundgren et al.lll995l ). a single 
Crab-like pulsar in M31 is would produce giant pulses 
detectable at the PoCo completeness limit at a rate of 
4 x 10~ 17 hr _1 . While this extremely low rate would be 
boosted by the fact that PoCo is sensitive to all Crab-like 
pulsars in M31 ([McLaughlin fc Cordesll200"3T ). our nonde- 
tection is easily consistent with expectations. Improving 
sensitivity of fast imaging systems will go a long way to 
detecting this source population, given its steep power- 
law index. For example, a fast imaging system at the 
EVLA would have a 5<r detection limit of about 25 mJy 
and could detect a Crab-like pulsar in M31 at a rate of 
1 x 10~ 3 hr" 1 . 

5. CONCLUSIONS 

We have demonstrated a new concept in radio interfer- 
ometry known as fast imaging. Observations with PoCo 
at the ATA has shown that the information available 
to radio interferometers can be used to encompass and 
extend upon the science of single-dish time domain as- 
tronomy. The principle challenges to implementing PoCo 
were the designing of a correlator to process multiple an- 
tennas at millisecond rates and efficiently searching the 
visibility data. The success of PoCo shows that these 
challenges can be met today to produce scientifically pro- 
ductive fast imaging systems. 

PoCo observations of known bright pulsars, B0329+54, 
and the Crab pulsar, were used to show that the system 
is sensitive to bright, millisecond pulses. We demon- 
strate several visibility-based pulse detection techniques 
and show they can detect and localize pulses anywhere 
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within the field of view of an interferometer. Since visi- 
bility data have higher dimensionality than that typically 
used in transients searches, these algorithms only scratch 
the surface of potential pulse search techniques. Measur- 
ing the computational demand of these search algorithms 
shows that more work is needed to process data as fast 
as it is acquired. Compute clusters will go a long way in 
this effort, since the search algorithms are very easy to 
parallelize. 

A short PoCo observation of M31 has placed the first 
constraints on the rate of fast transients from the entire 
galaxy simultaneously. Our search imaged the entire disk 
of M31 over a range of DMs with a completeness limit of 
190 Jy. No pulses were detected at this level, limiting the 
rate of millisecond-duration events in M31 to less than 
4.3 hr- 1 . 

Future developments will expand greatly on the sci- 
ence presented here. A fast imaging system at the 
EVLA would have the sensitivity to detect RRATs in 
our Galaxy or giant pulses in nearby galaxies. Scaling 
from PoCo, a fast imaging system at the EVLA would 
detect Crab-like pulses from nearby galaxies in obser- 
vations lasting tens of hours to tens of days. With an 
efficient pulse-detection algorithm, such a system could 
conduct real-time searches for pulses commensally with 
other observations to probe cosmologically significant 
volumes. Such surveys could find as-yet unknown classes 
of fast transients, while simultaneously localizing them 
and measuring their dispersion to constrain models of 
baryon density in the local universe. 
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